EQUIVALENCE OF DOMAINS ARISING FROM DUALITY OF 
ORBITS ON FLAG MANIFOLDS II 



TOSHIHIKO MATSUKI 

Abstract. In |GMlj . we denned a Gm-Kc invariant subset C(S) of Gc for each 
i^c-orbit 5" on every flag manifold Gc/P and conjectured that the connected 
component C(S)q of the identity will be equal to the Akhiezcr-Gindikin domain 
D if S is of nonholomorphic type. This conjecture was proved for closed S in WZ1 
IWZ2I iFHl IM6| and for open S in |M6| . In this paper, we prove the conjecture for 
all the other orbits when Gr is of non-Hermitian type. 



1. Introduction 

Let Gc be a connected complex semisimple Lie group and Gr a connected real 
form of Gc- Let Kc be the complexification in Gc of a maximal compact subgroup 
K of Gr. Let X = Gc/P be a flag manifold of Gc where P is an arbitrary parabolic 
subgroup of Gc- Then there exists a natural one-to-one correspondence between the 
set of i^c-° r bits S and the set of G^-orbits S' on X given by the condition: 

(1.1) S <-> S' S fl S' is non-empty and compact 

For each i^-orbit S we defined in [HMl] a subset C(S) of G c by 

C(S) = {i£ Gc | xS 1 fl S' is non-empty and compact} 

where S' is the GR-orbit on X given by (1.1). 

Akhiezer and Gindikin defined a domain D/Kc in Gc/Kc as follows ( |AGj ) . Let 
0r = t © m denote the Cartan decomposition of g®. = Lie(GR) with respect to K. 
Let t be a maximal abelian subspace in im. Put 

t+ = {Y 6 1 1 |a(K)| < | for all a G £} 
where £ is the restricted root system of gc with respect to t. Then D is defined by 

D = G K (exp t + )^ c - 
We conjectured the following in |GMlj . 

Conjecture 1.1. (Conjecture 1.6 in jGMlj) Suppose that X = Gc/P is not Kc- 
homogeneous. Then we will have C(S)o = D for all Kc-orbits S of nonholomorphic 
type on X . Here C(S)o is the connected component ofC(S) containing the identity. 
(See |GM1[ IM6j for the definition of the Kc-orbits of nonholomorphic type. When 
Gr is of non-Hermitian type, all the Kc-orbits are defined to be of nonholomorphic 
type.) 
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Let S op denote the unique open K c -B double coset in Gc where B is a Borel 
subgroup of Gc contained in P. It is shown in jH] and |M5j that D C C(S op ) . 
(The opposite inclusion D D C(S op ) is proved in |B|.) On the other hand the 
inclusion C(S op )o C C(S)q for every Kc-orbit S on X = G c /P is shown in [GM1 
Proposition 8.1 and Proposition 8.3. So we have the inclusion 

(1.2) D c C(S) . 

We have only to prove the opposite inclusion. 

For a simple root a with respect to B we can define a parabolic subgroup P a by 

P a = B U Bw a B 

where w a is the reflection for the root a. Let Sq be a closed Kq-B double coset in 
Gc- Let Si, . . . , Sg (£ — codinicSo) be a sequence of Kq-B double cosets in Gc and 
Oi\, . . . oil a sequence of simple roots such that 

and that 

dim c S k = dim c S + k 
for jfe = 1, . . . ,£ (c.f. |HM2] . p3] . [Hp]). Especially $ = S^. 
In this paper we first prove the following theorem. 

Theorem 1.2. Let x be an element o/Gq. If 1$ = xSor\S' op P ae ■ ■ ■ P ai is connected, 
then 

r, _ T ccl n c' p . . . p 

A k 1 1 ^op 1 o-i 1 a k+1 

is connected for k = 1, . . . ,£. (S' op is the unique closed Gr-B double coset in Gc 
which corresponds to S op by (1.1).) 

Remark 1.3. The sets Ik (k — 0, . . . , £) are always nonempty because xSoP ai ■ ■ ■ P a( = 
x ^o P = G c D S' op . 

Let S be a Kq-P double coset in Gc- Then we can write 

qd qcl c p p 

° — °k — > D Q- r ai ' ' ' r a k 

with some closed K^-B double coset Sq and a sequence «i, . . . , a k of simple roots 
( |M3| . |Sp| ) . Secondly we prove the following. 

Theorem 1.4. (i) If x e D d , then I k is connected. 
(ii) If x e D d n C{S), then I k = xS H S' k . 

As a corollary we solve Conjecture 1.1 for non-Hermitian cases: 

Corollary 1.5. Let Gr be simple and of non-Hermitian type. Then C(S)o = D 
for all the K^-orbits S ^ X on X = Gq/P- 

Proof. When S is open in Gc, the equality is proved in |M6j . So we may assume 
that S is not open. Let x be an element of D cl fl C(S). Then we have only to show 
that x 6 D. Since S k P ak+1 ■ ■ ■ P ai _ x n S op = 0, we have S' k P ak+1 ■ ■ ■ P ai _ x C S' op = 
by the duality ( |M2j ) and therefore 

^op-^V-i ■ ■ ■ Pa k+l n S k = 4>. 
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Hence 



xSf_ x fl S' — xS d P ak+1 • • • P ae _ 1 H S' — (j). 



For the orbit S^_i we defined the following domain Q in [GM2 . 

Q = {x e G c | xSl x n S' op = 0} o . 
It is shown in |FHj Theorem 5.2.6 and [M6J Corollary 1.8 that 

Q — D 



when Gr is of non-Hermitian type. Hence x G D. 



□ 



Remark 1.6. Recently |M7j proved Conjecture 1.1 for all non-closed i^c-orbits in 
Hermitian cases using Theorem 1.4. Thus the conjecture is now completely solved 
affirmatively 



The full flag manifold T of Gc is the set of the Borel subgroups of Gc- If we take 
a Borel subgroup B of Gc, then the factor space Gc/B is identified with T by the 
map 



It is known that every GiR-orbit (G]R-conjugacy class) on T contains a Borel subgroup 
of the form 



where j is a ^-stable Cartan subalgebra of 0m, S + is a positive system of the root 
system E of the pair (g c , j c ) and g c (j, a) = {X G gc | [Y, X] = a(Y)X for all Y G j} 



Roots in S are usually classified as follows. 

(i) If 9(a) = a and gc(j, a) C tc, then a is called a "compact root". 

(ii) If 9(a) = a and &c(h a ) C ntc, then a is called a "noncompact root". 

(iii) If 9(a) = —a, then a is called a "real root". 

(iv) If 9(a) ±a, then a is called a "complex root". 

For a simple root a of S + define the parabolic subgroup P a as in Section 1. By 
the same arguments as in Lemma 5.1 and [M3J Lemma 3, we can prove the 
following decomposition of P a /B = P X (C) into the P a fl Gig-orbits. 

Lemma 2.1. (i) If a is compact, then P Q = (P a fl G^)B. 

(ii) If a is noncompact or real, then P a /B = P X (C) = C U {oo} is decomposed 
into the three (P a nGm)o- orbits H + , H and Hq which are diffeomorphic to the upper 
half plane, the lower half plane and P 1 (IR) = Ml_l{oo}, respectively. (Sometimes H + 
and H_ are in the same P a fl G^-orbit.) 



2. Gr-ORBITS on the full flag manifold 



G c /B 3 gB ^ gBog- 1 G T. 




m, nn, H). 
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(iii) If a is complex, then P a /B is decomposed into the two P a fl G^-orbits con- 
sisting of a point yB and the complement (P a — yB)/B. 

Remark 2.2. Concerning the ii'c-action on Gc/B, it is shown in Lemma 5.1 
(c.f. jM3] Lemma 3, [HMT] Lemma 9.1) that: 

(i) If a is compact, then P a = (P a R K C )B. 

(ii) If a is noncompact or real, then P a /B is decomposed into three (P a D Kc)q- 
orbits consisting of two points and the complement. 

(iii) If a is complex, then P a /B is decomposed into two P a fl -fTc-orbits consisting 
of a point and the complement. 

As a corollary of Lemma 2.1 we have: 

Corollary 2.3. Let g be an arbitrary element of Gq. Then every (gP^g -1 flGfjo- 
invariant closed subset of gP a /B is connected. 

Remark 2.4. On the contrary a gP a g~ l D -fTc-hivariant closed subset of gP a /B may 
not be connected in view of Remark 2.2 (ii). 

3. Proof of the theorems 

Proof of Theorem 1.2. We will prove the theorem by induction on k. Suppose that 
Ik-x is connected. Then 

Ik-\Pa k = (^Sfc-1 H S op P ae ■ ■ ■ P ak )P ak 

_ r cc/ p, c' p . . . p 

— x>J k I I U op J a e 1 a k 

( T qd n q' p . . . p \p 

\^u k ii *J op -( a e 1 a k+1 ) 1 a k 

— hPa k 

is connected. Suppose that Ik = A\ U A 2 with some nonempty closed subsets A\ and 
A 2 of Ik- Then we will get a contradiction. Since the Borel subgroup B is connected, 
A\ and A 2 are right P-invariant. Since AiP ak and A 2 P ak are closed and 

A\Pa k U A 2 P ak = IkPa k 

is connected, we have AiP ak n A 2 P Qk ^ <fi. Take an element g of ^P^ fl A 2 P ak . 
Then gP afc fl is decomposed as 

g p ak n 4 = (#P afc n Ax) u (#p afe n A 2 ) 

with two nonempty closed subsets gP afc H Ai and gP afc fl But this contradicts 
Corollary 2.3 because gP ak nl k = gP ak C S^P^ • • • P ak+1 is gP ak 9~ l C G M -invariant. 

□ 

Lemma 3.1. (i) zs relatively closed in S op P ae ■ ■ ■ P ak+1 - 
(ii) 5*[. is relatively open in S' P ae ■ ■ ■ P ak+1 ■ 

Proof. By the duality for the closure relation ( |M3j ) we have only to show (i). Let 

5 be a Kc-B double coset contained in the boundary of Sk- Then 

codimcS* > codim c Sfc = £ — k. 
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Hence S cannot be contained in S op P ae ■ ■ ■ P ak+1 by jVj Lemma 5.1 (c.f. |GMlj 
Lemma 9.1). □ 

Proof of Theorem 1.4- (i) Since Sq/B is compact and S' /B is open, we see that 

C(So) = {x G Gc | xS fl S' is nonempty and closed in Gc} 

= {x E G c \ xS C S' }. 

Hence C(So)o is the cycle space for S' defined in |WWj . Since D C G(So)o by (1.2), 
it follows that 

x G D => xSo C S' . 
Suppose that x G D d . Then we have 

xSq c ^ c S op P ae • • • Pax 
and hence Iq = xSq is connected. By Theorem 1.2 the intersection 

T 1 — rp Qcl r> O' JD . . . P 

is connected. 

(ii) By Lemma 3.1 S' k is relatively open in S' op P ae ■ ■ ■ P ak+1 - On the other hand 
S is also relatively open in S cl . Hence 

(3.1) xS fl S' k is relatively open in Ik = xS d fl S'P at ■ ■ ■ P ak+1 - 

Suppose that x G C(S). Then xSnS' is nonempty and closed in G c by definition. 
Since S' k is relatively closed in 5", it follows that 

(3.2) xS fl S' k is closed in Gc- 
Since xS fl S' = (xS fl S' k )P, it also follows that 

(3.3) xS fl S' k is nonempty. 

Suppose moreover that x G D cl . Then I k is connected by (i). Hence it follows 
from (3.1), (3.2) and (3.3) that 

i k = xSn s k . □ 
References 

[A] K. Aomoto, On some double coset decompositions of complex semi-simple Lie groups, J. 
Math. Soc. Japan 18 (1966), 1-44. 

[AG] D. N. Akhiezer and S. G. Gindikin, On Stein extensions of real symmetric spaces, Math. 
Ann. 286 (1990), 1-12. 

[B] L. Barchini, Stein extensions of real symmetric spaces and the geometry of the flag mani- 
fold, Math. Ann. 326 (2003), 331-346. 

[FH] G. Fels and A. Huckleberry, Characterization of cycle domains via Kobayashi hyperbolicity, 
preprint (AG/0204341). 

[GM1] S. Gindikin and T. Matsuki, Stein extensions of Riemannian symmetric spaces and dual- 
ities of orbits on flag manifolds, Transform. Groups 8 (2003), 333-376. 

[GM2] S. Gindikin and T. Matsuki, A remark on Schubert cells and duality of orbits on flag 
manifolds, preprint (RT/0208071). 

[H] A. Huckleberry, On certain domains in cycle spaces of flag manifolds, Math. Ann. 323 
(2002), 797-810. 



6 



TOSHIHIKO MATSUKI 



[Ml] T. Matsuki, The orbits of affine symmetric spaces under the action of minimal parabolic 

subgroups, J. Math. Soc. Japan 31 (1979), 331-357. 
[M2] T. Matsuki, Orbits on affine symmetric spaces under the action of parabolic subgroups, 

Hiroshima Math. J. 12 (1982), 307-320. 
[M3] T. Matsuki, Closure relations for orbits on affine symmetric spaces under the action of 

minimal parabolic subgroups, Adv. Stud. Pure Math. 14 (1988), 541-559. 
[M4] T. Matsuki, Closure relations for orbits on affine symmetric spaces under the action of 

parabolic subgroups. Intersections of associated orbits, Hiroshima Math. J. 18 (1988), 59- 

67. 

[M5] T. Matsuki, Stein extensions of Riemann symmetric spaces and some generalization, J. 

Lie Theory 13 (2003), 563-570. 
[M6] T. Matsuki, Equivalence of domains arising from duality of orbits on flag manifolds, 

preprint (RT/0309314). 

[M7] T. Matsuki, Equivalence of domains arising from duality of orbits on flag manifolds III, 
preprint (RT/0410302). 

[R] W. Rossmann, The structure of semisimple symmetric spaces, Canad. J. Math. 31 (1979), 
157-180. 

[Sp] T. A. Springer, Some results on algebraic groups with involutions, Adv. Stud. Pure Math. 
6 (1984), 525-534. 

[V] D. A. Vogan, Irreducible characters of semisimple Lie groups III, Invent. Math. 71 (1983), 
381-417. 

[WW] R. O. Wells and J. A. Wolf, Poincare series and automorphic cohomology on flag domains, 

Ann. of Math. 105 (1977), 397-448. 
[WZ1] J. A. Wolf and R. Zierau, Linear cycle spaces in flag domains, Math. Ann. 316 (2000), 

529-545. 

[WZ2] J. A. Wolf and R. Zierau, A note on the linear cycle spaces for groups of Hermitian type, 
J. Lie Theory 13 (2003), 189-191. 

Department of Mathematics, Faculty of Science, Kyoto University, Kyoto 606- 
8502, Japan 

E-mail address: matsuki@math.kyoto-u.ac.jp 



